Sign Language Recognition with Kinect

نویسندگان

  • Simon Lang
  • Raúl Rojas
چکیده

A framework for general gesture recognition is presented and tested with isolated signs of sign language. Other than common systems for sign language recognition, this framework makes use of Kinect, a depth camera developed by Microsoft and PrimeSense, which features easy extraction of important body parts. Recognition is done using hidden Markov models with a continuous observation density. The framework also o ers an easy way of initializing and training new gestures or signs by performing them several times in front of the camera. Results show a recognition rate of > 97% for eight out of nine signs when they are trained by more than one person.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Persian sign language detection based on normalized depth image information

There are many reports of using the Kinect to detect hand and finger gestures after release of device by Microsoft. The depth information is mostly used to separate the hand image in the two-dimension of RGB domain. This paper proposes a method in which the depth information plays a more dominant role. Using a threshold in depth space first the hand template is extracted. Then in 3D domain the ...

متن کامل

Sign Language Recognition and Translation with Kinect

Sign language (SL) recognition, although has been explored for many years, is still a challenging problem for real practice. The complex background and illumination conditions affect the hand tracking and make the SL recognition very difficult. Fortunately, Kinect is able to provide depth and color data simultaneously, based on which the hand and body action can be tracked more accurate and eas...

متن کامل

Building an Application for Learning the Finger Alphabet of Swiss German Sign Language through Use of the Kinect

We developed an application for learning the finger alphabet of Swiss German Sign Language. It consists of a user interface and a recognition algorithm including the Kinect sensor. The official Kinect Software Development Kit (SDK) does not recognize fingertips. We extended it with an existing algorithm. Posted at the Zurich Open Repository and Archive, University of Zurich ZORA URL: https://do...

متن کامل

Sign Language Recognition with the Kinect Sensor Based on Conditional Random Fields

Sign language is a visual language used by deaf people. One difficulty of sign language recognition is that sign instances of vary in both motion and shape in three-dimensional (3D) space. In this research, we use 3D depth information from hand motions, generated from Microsoft's Kinect sensor and apply a hierarchical conditional random field (CRF) that recognizes hand signs from the hand motio...

متن کامل

A Novel Occlusion Sign Language Recognition

Sign language plays an important role in communicate with changers that hearing improved. However, the sign language in many countries and areas different and auto recognition system became the research way in recent year. In this paper, we devise a novel method for occlusion processing in Taiwan Sign Language recognition system. Our method employs adxl345 and Kinect to extract the feature of s...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011